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Abstract 

We  investigate  when  sampling  a  stochastic  process  X  =  { A'(t)  ;  t  >  0}  at  the  times  of 
an  independent  point  process,  leads  to  the  same  empirical  distribution  as  the  time 
average  limiting  distribution  of  X.  Two  cases  are  considered.  The  Srst  is  when  X  is  an 
asymptotically  stationary  ergodic  process  and  satisfies  a  mixing  and  coupling  condition. 
In  this  case,  the  entire  limiting  distributions  in  function  space  are  shown  to  be  the  same. 
The  second  case  is  when  X  is  only  assumed  to  have  a  constant  finite  time  average  and  rj) 
is  assumed  a  positive  recurrent  renewal  processes  with  a  spread-out  cycle  length  distribu¬ 
tion.  In  this  non-ergodic  case,  the  averages  are  shown  to  be  the  same  when  some  further 
conditions  are  placed  on  X  and  il>. 
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1.  Introduction 

Quite  a  bit  of  literature  has  been  devoted  to  establishing  that  under  suitable  conditions,  the  time  average 
distribution  of  a  stochastic  process  X  —  {X{<)  :  f  >  0}  is  the  same  as  when  averaging  over  the  sampling 
times  of  an  underlying  point  process  =  {tn  '■  n  >0).  Formally  this  amounts  to  showing  that  for  a  set  A  in 
the  state  space  of  X, 

lim  -  /  IiX{s)  e  A)ds  =  lim  -  y"  /(X(f„)  e  .4),  (1.1) 

t-.oo  t  Jg  n-.oo  n 

where  /(X(s)  G  A)  denotes  the  indicator  fimction  for  the  event  {A’(s)  €  A}. 

The  main  emphasis  in  the  literature  has  dealt  with  the  case  when  X  and  V’  are  dependent;  for  example 
when  tn  is  the  arrival  time  of  the  n*'*  customer  to  a  queueing  system  (with  which  each  arrival  interacts), 
and  X{t)  is  the  state  of  the  system  at  time  t.  The  classic  and  fundamental  result  in  this  regard  is  PASTA 
(Poisson  Arrivals  See  Time  Averages)  (Wolff[13])  which  states  that  under  a  so-called  Lack  of  Anticipation 
Property,  sampling  by  a  Poisson  process  does  the  trick.  In  such  cases,  path  regularity  assumptions  (such  as 
left  or  right  continuity)  are  placed  on  X  because  X(tn—)  need  not  be  equal  to  ). 

Many  papers  generalizing,  extending  and  giving  converses  to  PASTA  have  appeared  in  recent  years, 
giving  rise  to  the  general  notion  of  ASTA  (Arrivals  See  Time  Averages)  (Miyazawa  and  Wolff  [10],  Melamed 
and  Whitt(8|,[9],  Green  and  MelamedfS],  WolfT[14],  Konig,  D.  and  V.  Schmidt  [6],  Bremaud  [2],  Bremaud  et. 
al.[3|).  Nevertheless,  it  seems  that  perhaps  the  easiest  case  has  not  been  seriously  studied:  the  case  when  X 
and  i)  are  independent  (but  not  necessarily  stationary). 

The  purpose  of  the  present  paper  is  to  fill  in  this  gap.  We  don’t  assume  any  path  regularity  assumptions 
for  X  nor  do  we  assume  that  X  or  xl)  are  stationary  processes.  The  problem  turns  out  to  be  more  difiScult 
than  one  might  expect.  We  consider  two  set-ups.  In  the  first  (section  2)  X  is  assumed  asymptotically 
stationary  ergodic  (ASE)  and  ip  is  assumed  a  point  process  that  admits  coupling  to  a  stationary  version 
and  is  mixing.  We  show  that  the  sampled  process  has  the  same  limiting  distribution  (Theorem  2.1.).  The 
distributions  we  deal  with  are  those  in  function  space  (not  just  the  marginal  distribution  as  in  (I.l)).  As 
a  corollary  (Corollary  (2.1)),  it  is  seen  that  if  is  ASE  and  ^  is  a  positive  recurrent  renewal  process  with 
a  spread-out  cycle  length  distribution  then  the  result  holds.  Finally,  we  give  a  general  converse  that  does 
not  require  any  further  conditions  (Theorem  2.2),  and  counterexamples  (Ilemark(2.2))  showing  that  neither 
a  non-lattice  renewal  process  nor  a  stationary  one  nor  one  with  a  smooth  delay  cycle  is  sufficient  to  obtain 
Corollary  (2.1). 

In  the  second  set-up  (section  3)  we  are  no  longer  interested  in  equating  d'stributions  as  in  (1.1)  but  only 
the  average  of  a  real- valued  process: 

For  example,  X  could  be  of  the  form  X{t)  =  I{Y{t)  €  A}  where  Y  has  a  general  state  space  and  A  is  a 
fixed  set  of  states.  Or  X  could  be  a  deterministic  real  valued  function  X(t)  =  x(t)  with  a  finite  Cesaro 
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limit.  Therefore,  in  this  case,  X  is  not  assumed  asymptotically  stationary  ergodic.  We  assume,  though,  that 
the  point  process  is  renewal  with  a  spead-out  cycle  length  distribution.  A  further  moment  condition  is  also 
assumed. 


2,  The  Asymptotically  Ergodic  Case  and  a  General  Converse 

Let  X  =  {X(t)  :  <  >  0}  be  a  stochastic  process  on  some  underlying  probability  space  with  X(t) 

taking  values  in  the  state  space  S  (a  measure  space  endowed  with  <T-field  P).  We  assume  that  X{t,  w)  {t  >  0, 
«;  €  n)  is  jointly  measurable  and  view  X  as  a  random  element  of  the  function  space  K,  endowed 

with  the  product  <7-field. 

We  wish  to  sample  X  at  the  times  of  an  independent  point  process  ^  =  {t„  :  n  >  0}.  To  start  with, 
we  assume  that  X  and  r  are  on  the  same  probability  space,  and  that  V’  Is  simple,  that  is,  that  the  are 
strictly  increasing  (to  infinity)  as  n — »oo. 

We  view  ip  as  a  random  point  measure  on  71+ ,  where  for  any  Borel  set  A  C  71+ , 

<X> 

rP(A)  =  '£l{t„eA}.  (2.1) 

n=0 


We  let  ip(t)  ^((0,<])  denote  the  associated  counting  process. 

M  denotes  the  space  of  all  point  measures,  p  =  p{-),  that  are  bounded  on  compact  intervals,  equiped 
with  the  w  topology  (and  associated  Borel  sets)  defined  via:  pk — «s  n — >00  iff  for  each  bounded  continu¬ 
ous  function,  /  :  71+ — *71,  with  compact  support,  pk{f) — ^A*(/)-  This  makes  M.  into  a  complete  separable 
metric  space  (consult  for  example  page  628  of  Daley  and  Vere-J(Mies[4]).  ip  is  assumed  a  random  element  of 
M. 

For  s  >0,  0,  :K  —*  K  denotes  the  shift  operator  {9,x){t)  =  z(s  -I- 1),  and  it  also  will  be  used  to  denote 
the  shift  on  Ad;  0,ip{A)  =  ip{s  +  A). 

We  say  that  X  is  asymptotically  stationary  ergodic  (ASE)  with  respect  to  the  time  shifts  {d*},  if  there 
exists  a  limiting  probability  distribution,Q,  on  AC  in  the  sense  that  for  all  measurable  sets  A  C  AC 


Q(A)  =  lim-  f  I{0,oX  €  A)ds,  a.s.P. 
«-*<»  t  Jo 


(2.2a) 


The  measure  Q  is  necessarily  stationary  and  ergodic  with  respect  to  the  shifts  and  if  X*  denotes  a  process 
with  distribution  Q,  Q{A)  =  P{X*  €  A),  then  X*  is  a  time  stationary  ergodic  process. 

ASE  is  equivalent  to  (2.2a)  holding  for  all  non-negative  measurable  functions  /  :  AC — *71+  (see  page  101 
of  Loeve  [7j): 

Qif)  =  lim  I  /  ne,oX)ds-  a.s.P,  (2.26) 

and  is  also  equivalent  to;  for  all  measurable  sets  Ao,  A 


P{X  6  Ao)Q(A)  =  lim  7  f* P{X  e  Ao,  0,X  e  A)ds. 
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ASE  holds  if  (for  example)  X  is  positive  recurrent  regenerative  or  stationary  ergodic  or  is  a  positive 
Harris  recurrent  Markov  process. 

We  say  that  ^  is  mixing  if  for  all  Borel  sets  Bq  and  B, 

P(V' €  So,  tfgV' €  B) — €  Bo)M{B),  as  s — >00,  (2.3) 

where  M  denotes  a  probability  measure  on  M.  Mixing  implies  ergodicity  (via  (2.2c));  so  in  particular  M  is 
a  stationary  ergodic  measure  with  respect  to  the  shifts  and  letting  rp*  denote  a  random  point  process  with 
distribution  M,  ip  is  stationary  ergodic.  It  is  easily  seen  that  ip*  is  also  mixing.  A  Eip*(l)  denotes  the 
intensity  of  ip  which  we  assume  is  finite  and  non-zero. 

We  say  that  ip  admits  coupling  to  ip*  if  there  exists  versions  of  ip  and  ip*  on  the  same  probability  space 
together  with  a  proper  random  time  T  such  that  6gip  =  6,ip*\  s  >T. 

Theorem  2.1.  Suppose  X  is  ASE  with  limiting  distribution  Q  tom  (2.2a).  Ifr  is  independent  of  X  and 
is  mixing  and  admits  coupling  to  ip*  then  sampling  by  ip  leads  to  the  same  limiting  distribution: 


1 

Q(A)  =  lim  -  oX  6  A)  a.s.P.  (2.4) 

Proof:  Consider  the  joint  random  element  Z  =  {X,ip)  on  the  product  space  Kx  M.  It  suffices  to  prove 

the  theorem  for  stationary  version  ip*  =  {t;},  for  suppose  (2.4)  holds  for  (X,  ip*).  Then  by  using  the  coupling 
time  T,  we  can  define  discrete  random  times  Si  min{n  :  >  T},  and  S2  min{n  :  >  T},  and  deduce 

that  tsi+n  =  inipl3ang  that  (2.4)  will  hold  for  Z.  For  the  rest  of  the  proof,  we  assume  that 

iP  =  iP*- 

We  shall  first  show  that  Z  is  jointly  ASE  with  limiting  distribution  QxM.  This  is  equivalent  to  showing 
that  the  stationary  measure  Q  x  M  is  ergodic  and  that  for  all  measurable  sets  C  in  the  product  <r-field  (of 
KxM) 

(Q  X  M)(C)  =  lim]  f  P{9,{X,  iP)  g  C)ds.  (2.5) 

‘^00  tJo 

To  establish  (2.5),  define  for  each  y  G  A4  the  section  A(y)  {(x,i/)  e  K  x  M  :  (x,y)  e  C}.  Then  by 
Fubini’s  Theorem  and  independence,  for  each  t 

\  [  Pie,{X,  1P)  G  C)ds  =  f  I  fp(e,X  G  A(y))M(dy).  (2.6) 

Jm  '■Jo 

By  the  Dominated  Convergence  Theorem,  (2.6)  converges  as  t — >00  to 

/  Q{A{y))M{dy)  =  {Q  x  M)(C),  (2.7) 

Jm 

the  last  step  once  again  due  to  Fubini’s  Theorem. 
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(2.8) 


QxM  is  indeed  stationary,  but  to  prove  ergodicity  (via  (2.2c)),  letting  (X*,  V')  have  this  joint  stationary 
distribution  ,  it  suffices  to  show  (see  Lemma  10.3.II,  page  341  of  Daley  and  Vere-Jones[4])  that  for  all 
measurable  cylinder  sets  (ylo,  Bo),  (A,  B) 

Q{Ao)Q{A)M{Bo)M{B)  =  lim  \  f  P(X*  e  Ao.O.X*  €  A)P{^  e  Bo,e,rP  €  B)ds. 

t  Jo 

This  follows  easily  from  (2.3)  and  the  ergodicity  of  Q. 

Thus  (via  (2.2b)  we  have  that  for  all  measurable  /  :  AC  x  M — >72+ 

iQ  X  M)(/)  =  lim  i  /  Jie,  o  X)ds-,  a.s.P. 
f—oo  t  Jo 

In  (2.9),  choose,  for  fixed  Borel  set  A,  the  function 

f{X,i,)^x-^'£l{et^XeA}, 


(2.9) 


n~0 


so  that  the  limit  in  (2.9)  is 


v-d) 


(Q  X  M)if)  =  Eif{X\  V-))  =  5^  I{et„X*  e  ^}  =  QiA), 


(2.10) 


(2.11) 


n=0 


the  last  equality  due  to  the  independence  and  stationarity  of  X*  and  xp.  Moreover, 

/  f{e,x,e,xp)ds  =  x-^  Y'  I{et„x  €  A}ds  =  X-'^  Y  i{et„xeA}  i{tie{s,s  +  i]}ds.  (2.12) 

n=V-(.)  n=0 

The  last  integral  tends  to  1  as  i — >00  and  +  1)  -  V’(t))/t — >0,  so  we  obtain 

.  V'(t) 

Q{A)  =  lim  Y. ^  (2.13) 

Since  rp{t)/t — ►A,  we  finally  obtain  (2.4).  ■ 

A  distribution  F  on  is  said  to  be  spread-out  if  for  sonu  integer  m  >  1,  the  convolution  F*  ■*  F, 
m  times,  has  an  absolutely  continuous  component  with  respect  to  Lebesgue  measure. 

Corollary  2.1.  Suppose  t  is  a  positive  recurrent  renewed  process,  independent  of  X  and  has  a  spread-out 
cycle  length  distribution.  Then  if  X  is  ASE  with  limiting  distribution  Q,  (2.4)  bolds. 


Proof:  For  each  fixed  t,  let  Ft  denote  the  a-field  generated  by  the  point  measures  restricted  to  [0,  f]: 

{^(s)  :  s  <  <}.  The  spread-out  condition  is  both  the  sufficient  and  necessary  one  for  renewal  process  ip 
to  admit  coupling  to  a  stationary  version  ip*  and  do  so  for  any  initial  condition  of  the  form  ip  e  Ft-  (an 
immediate  consequence  of  the  corresponding  result  concerning  the  Markov  process  of  forward  recurrence 
times  for  ip  (see  for  example  Theorem  2.3,  page  146  in  Asmussenfl])).  Similarly,  from  this,  it  also  follows 
that  0,ip  converges  in  total  variation  to  limiting  distribution  egardless  of  such  initial  conditions  (see 
Corollary  1.5  page  142  of  [1]).  In  particular,  for  each  fixed  measurable  B,  mbcing  condition  (2.3)  holds  for 
any  Bo  €  assume  without  loss  of  generality  that  ip  is  stationary  (via  coupling)  and  thus 

since  U4>o  Ft  forms  a  semiring  that  generates  the  Borel  sets  of  M,  the  proof  is  complete  by  Lemma  10.3.II 
in  [4].  ■ 
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We  now  consider  the  converse  of  Theorem  2.1  (i.e.  we  assume  (2.4)  and  try  to  deduce  (2.2a))  and  find 
that  we  do  not  need  the  mixing  condition  on  rp  nor  any  ergodicity  condition  on  X . 


Theorem  2.2.  If  X  is  a  stochastic  process  and  r  is  a  point  process  independent  of  X  that  admits  coupling 
to  a  stationary  version  such  that  for  some  fixed  measurable  set  A  C  X, 

1  " 

Urn  -yi(fft,oX  eA)  =  a  a.s.P,  (2.14) 

n— *oo  fi 

k=l 


with  oc  a  constant,  then 


lim  \  f  1(6^  o 
t  Jo 


X  €  A)ds  =  a,  a.s.P. 


(2.15) 


Proof:  If  (2.14)  holds  for  {'4>,X),  then  it  will  also  hold  for  {‘ip*,X)  by  coupling  V'  to  ip*.  Thus  it  suffices 

to  prove  (2.15)  in  the  stationary  case.  FYom  (2.14)  it  follows  that  as  t — >00 


-'^liOt^oX  eA)—*\a  a.s.P. 

*  fc=i 

Since  the  summation  is  bounded  above  by  the  which  is  Uniformly  Integrable  (UI)  (due  to  stationarity), 
1  P  1 

-  lie^oXe  A)Xds  =  E{j  Y'  J{et,  oXe  >l)|Xl— a.s.P 
t Jo  t 

Dividing  by  A  gives  (2.15).  ■ 

R3mark(2.1):  Another  way  of  understanding  Theorem  (2.1)  is  through  Palm  theory  : 

Under  the  hypothesis  of  the  theorem,  the  time  stationary  distribution  of  {X,  ip)  isQ  x  M 
and  the  sampled  stationary  distribution  is  the  Palm  distribution  of  QxM  (see  for  example 
Rolskijll])  which  in  this  case  is  precisely  Q  x  where  Af®  is  the  Palm  distribution  of 
M .  The  Palm  distribution  is  defined  via 

v>(i) 

(Q  X  M)°(f)  =  X-^Eq.m 

n—0 

and  denotes  the  limiting  distribution  obtained  by  averaging  the  distribution  of  (X,  ip)  over 
all  the  sampling  times  t„.  The  Palm  distributicMi  is  stationary  ergodic  with  respect  to  the 
shifts  flfn',  in  particular,  under  the  interarrival  times  {t„  —  t„_i}  form  a  stationary 
ergodic  sequence. 

Remark(2.2):  A  non-lattice  cycle-length  <listribution,F,  is  not  enough  to  ensure  Corollary 
2.1  :  Define  a  cyclic  deterministic  process  X(t)  =  t  —  n;  n<t<n-l-l,  (the  fractional 
part  of  t).  Let  A  denote  the  set  of  irrational  numbers  in  (0, 1)  and  take  F  to  have  mass 
only  on  the  rationals  (with  positive  mass  on  each  rational).  Then  the  time  average  of 
I{X{s)  e  A}  is  1  but  the  sampled  average  is  0.  In  fact,  when  F  is  not  spread-out,  then 
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by  only  smoothing  out  the  first  (i.e.  the  delay)  cycle  length  (making  it  spread-out)  or 
cho  jsing  a  stationary  renewal  process,  Corollary  2.1  once  again  is  false:  Break  up  TZ+  into 
the  odd  half  intervals  [n,  n  -f-  1/2),  and  even  half  intervals  [n  -f-  1/2,  n  -|-  1],  n  >  0,  and 
define  X{t)  to  be  1  on  the  even  ones  and  0  on  the  odd  ones  so  that  the  time  average  of 
{X(s)  =  1}  is  .5  a.s.  For  sampling,  take  a  deterministic  renewal  process  with  interevent 
times  identically  1,  but  let  t\  have  a  C/m/(0, 1)  distribution  (this  results  in  making  the 
renewal  process  time  stationary  ).  Then  with  probability  .5,  the  event  {f  i  <  .5}  will  occur 
in  which  case  X(<„)  =  0  for  all  n,  giving  the  event  average  as  0  w.p.  .5. 


3.  The  Non-Ergodic  Case  With  Renewal  Sampling 


In  section  2  we  assumed  that  X  was  asymptotically  ergodic  which  then  allowed  us  to  use  ergodic  theory  to 
deduce  our  desired  result.  Suppose,  however,  that  for  a  stochastic  process  X  we  only  know  that  for  some 
fixed  marginal  Borel  set  >1  C  <S  that 


^lim  y  J  I{X{s)  e  =  a,  a.s.P. 


(3.1) 


where  a  is  a  finite  constant.  X  need  not  be  AE  to  satisfy  (3.1)  so,  in  this  section,  we  investigate  suflBcient 
conditions  ensuring  that 

1  " 

a=  \]m  -Yl{X(tk)€A}  a.s.P,  (3.2) 

n— *00  fi 


wh'H  V*  is  independent  of  X. 

We  shall  actually  be  interested  in  obtaining  the  more  general  result  of  equating  averages  for  a  real- valued 
process  X.  In  this  case 


1  /•* 

a  =  lim  --  /  X(s)ds,  a.s.P, 

is  assumed  to  exist  and  we  wish  to  give  sufficient  conditions  ensuring  that 


(3.3) 


a  = 


a,s,P, 


(3.4) 


Whereas  one  would  expect  (3.4)  to  hold  under  fairly  general  conditions,  we  no  longer  have  ergodic  theory 
at  our  disposal  and  hence  must  resort  to  a  different  approach  which  for  us  requires  ffom  the  start  assuming 
that  0  is  renewal  with  a  spread-out  cycle  length  distribution.  Let  T  denote  a  generic  cycle  length. 

Theorem  3.1.  Suppose  X  =  {A(t)}  is  a  jointly  measurable  boimded  process  for  which  (3.3)  holds  for 
finite  constant  a.  If  is  a  renewal  process  independent  of  X,  with  a  spread-out  cycle  length  distribution, 
satisfying  <  oo,  for  some  e  >  0  then  (3.4)  holds. 
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Proof:  Assume  sup^  A'(<)  <  M  <  cx>,  and  Let  x!)*  denote  a  time  stationary  version  of  i>  (to  which,  due  to 

the  spread-out  assumption  xp  admits  coupling).  It  suffices  to  show  that 

Aa  =  lim  Xitl)  a.s.P.  (3.5) 

‘  fc=i 

Let  U(t)  =  Exp{t)  denote  the  renewal  measure  for  xp.  First  observe  that 


’^*(0  H  ft 

Y]  Xitl)  =  /  EXis)ExP*ids)  =  A  /  EXis)ds, 

Jo  Jo 


and  that  similarly  (see  page  136  of  Daley  and  Vere-Jones(4]) 


^*(‘1  ft  ft  ft-a 

E{  Y  Xitl)y  =  A  /  EX‘^{s)ds  +  2XE  /  X{s  +  u)Uidu)X{s)ds. 

Jq  Jo 


Consequently 


V’  (*)  X  P  X  P  /■*“* 

Var{  Y  XitD/t)  =  ^  /  EX^(s)ds  +  2~E  /  /  ^(s  H-  u)iUidu)  -  Xdu)Xis)ds 

tr!  t  Jo  *  Jo  Jo 

(3.8) 

<  A-—-  +  2—  .  >  Y.  i\Uidu)  -  AdwKfc  -I-  [0,1])). 

*  * 

Using  the  hypothesis  that  <  oo,  we  apply  Theorem  1  of  Stone  and  Wainger[12]  to  deduce  that  the 

last  integreil  in  (3.8)  reduces  to 


ft  l‘-»J 
Jo  tTn 


yielding  (after  integration) 


and  finally 


y  Ayf2  \2  A/f  2 

Var{  Y  Xitim  +  2-^0(f2-‘), 

fc=i 


v-'lt) 

For{^  AXW}  =  0(f-). 

k=l 


Using  the  susequence  s„  ^  n«  in  (3.11)  we  therefore  obtain 


V'orf  Y  Xitl)/s„}  =  0{^). 


(3.10) 


(3.11) 


(3.12) 


Applying  Chebychev’s  inequality  while  using  Borel-Cantelli,  yields 


1  1  /■»!. 

—  Y  Xitl)  -  A—  /  £:A(s)ds— 0,  O.S. 

®n  Jo 


(3.13) 
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as  n — >00.  By  bounded  convergence,^  Jg*"  EX(s)ds — *a,  hence  by  (3.13) 

.  V'*(Sn) 

-  ^  Xitl)-*a  a.s.  (3.14) 

*=i 

Let  n(t)  denote  the  (deterministic)  counting  process  for  {«„}.  To  prove  (3.5)  from  (3.13),  observe  that 
for  any  t,  there  exists  an  n{t)  such  that 


<t<  (n{t)  +  1)^'^‘, 


(3.15) 


so 


,  f-  ^  *  Y-  V-/  ,  y  K-J 


the  second  to  last  piece  of  which  tends  to  zero.  But  the  same  argument  as  used  above  can  be  used  on  |A'(f)|, 
implying  that  the  last  piece  in  (3.16)  also  tends  to  zero  and  thus  proving  (3.5).  ■ 


R€mark(3.1):  If  X  is  not  bounded,  then  Theorem  3.1  may  fail  even  for  Poisson  arrivals  as 
the  following  counterexample  shows:  Define  X(t)  =  for  t  €  [n,n+  1/n^),  X(t)  =  0 
otherwise.  Then  the  limit  in  (3.3)  is  1  whereas  the  limit  in  (3.4)  is  0. 

Remark(3.2):  When  X  is  a  bounded  process,  then  Theorem  2.2  extends  to  averages  as  in 
(3.4). 
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